MAXENT3D_PID: An Estimator for the Maximum-Entropy Trivariate Partial Information Decomposition
نویسندگان
چکیده
منابع مشابه
A Maximum Entropy Estimator for the Aggregate Hierarchical Logit Model
A new approach for estimating the aggregate hierarchical logit model is presented. Though usually derived from random utility theory assuming correlated stochastic errors, the model can also be derived as a solution to a maximum entropy problem. Under the latter approach, the Lagrange multipliers of the optimization problem can be understood as parameter estimators of the model. Based on theore...
متن کاملThe Limited Information Maximum Likelihood Estimator as an Angle
When an econometric structural equation includes two endogenous variables and their coefficients are normalized so that their sum of squares is 1, it is natural to express them as the sine and cosine of an angle. The Limited Information Maximum Likelihood (LIML) estimator of this angle when the error covariance matrix is known has constant variance. Of all estimators with constant variance the ...
متن کاملMaximum entropy good-turing estimator for language modeling
In this paper, we propose a new formulation of the classical Good-Turing estimator for -gram language model. The new approach is based on defining a dynamic model for language production. Instead of assuming a fixed probability distribution of occurrence of an -gram on the whole text, we propose a maximum entropy approximation of a time varying distribution. This approximation led us to a new d...
متن کاملThe Partial Entropy Decomposition: Decomposing multivariate entropy and mutual information via pointwise common surprisal
Obtaining meaningful quantitative descriptions of the statistical dependence within multivariate systems is a difficult open problem. Recently, the Partial Information Decomposition (PID) was proposed to decompose mutual information (MI) about a target variable into components which are redundant, unique and synergistic within different subsets of predictor variables. Here, we propose to apply ...
متن کاملA Microeconomic Interpretation of the Maximum Entropy Estimator of Multinomial Logit Models and Its Equivalence to the Maximum Likelihood Estimator
Maximum entropy models are often used to describe supply and demand behavior in urban transportation and land use systems. However, they have been criticized for not representing behavioral rules of system agents and because their parameters seems to adjust only to modeler-imposed constraints. In response, it is demonstrated that the solution to the entropy maximization problem with linear cons...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Entropy
سال: 2019
ISSN: 1099-4300
DOI: 10.3390/e21090862